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Abstract 

Small quantum systems non-weakly coupled to a bath become in 
the quantum regime surrounded by a cloud of photons or phonons, 
which modifies their thermodynamic behavior. Exactly solvable ex- 
amples are the Brownian motion of a quantum particle in a harmonic 
confining potential and coupled to a harmonic quantum thermal bath, 
e.g. an ion in a Penning trap, and a spin immersed in a bosonic bath, 
as occurs in NMR physics. It appears that the Clausius inequality 
&Q < TdS can be violated. For non-adiabatic changes of system pa- 
rameters the rate of energy dissipation can be negative, and, out of 
equilibrium, cyclic processes are possible which extract work from the 
bath. Experimental setups for testing some of the effects are discussed. 

1 Introduction 

The microscopic basis of thermodynamics is statistical physics and equilib- 
rium is described by the Gibbs distribution. It is typically taken for granted 
that, when going to the quantum regime, the classical Gibbs distribution can 
just be replaced by its quantum analog. It is not often stressed that this is 
only allowed in case of weak coupling with the bath. When that coupling 
is not weak, the Gibbs state of the total system (subsystem+bath) leads, 
after tracing out the bath, to a non-Gibbsian state for the subsystem. This 
endangers (near-) equilibrium thermodynamics. We analyze the situation for 
two exactly solvable problems. 
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A Letter on the thermodynamics of quantum Brownian motion appeared PQ, 
and was discussed in the scientific literature j2] [H]. This encouraged many 
others to investigate foundations of the second law, see the proceedings of 
conference 'Quantum Limits to the Second Law', San Diego, July 2002 [5]. 
Many details on the thermodynamics of the model were presented in ref . [3] . 

A thermodynamic analysis of the somewhat related spin-boson model 
appeared in ref. [U]. 



2. Quantum Brownian motion 



The Hamiltonian for a harmonic oscillator in a bath of harmonic oscillators 
reads ( "Caldeira-Leggett model") H = Hs + H-b + with |3] 



h = — + -ax 2 + y 
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The interaction Hamiltonian includes a self-interaction. In certain situations 
it is self-generated, else the prefactor of the total x 2 -term should be large 
enough to make the splitting with a positive a is possible. Examples of 
quantum Brownian motion are: fluctuation effects in Josephson junctions, 
low-temperature quantum transport, and quantum-optical systems (e.g. an 
ion in a Penning trap) 

We assume for simplicity that the levels of the bath are equally spaced, 
uji = i A, and a very small level spacing A corresponds to a large, extensive 
bath, allowing a sharp definition of temperature, thus providing a basis for 

2 

thermodynamics. The so-called spectral density J{uj) = J2i ^ i ^( u * ~ u ) * s 
called Ohmic when J(u) = juj for small lu; we shall consider the quasi-Ohmic 
Drude-Ullersma spectrum, where the large-u; behavior is cut-off at the Debye 
frequency T, i.e. J{uS) = r yujT 2 /(u 2 + V 2 ). 



a Stationary distribution. 

The Wigner function of the subsystem is long known. By considering a 
Gibbsian for the total system and summing out the bath one gets 

W(x,p) = ^ exp(-^) x -Lexpt--^) (2.2) 
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Figure 2.1: The effective temperatures T p (upper plot), T x (middle plot) 
versus the bath temperature T (lower plot) for /ry/(47rm) = 1, hT/(2n) = 
100. Left: am/7 2 — 80 (underdamping); Right: am/7 2 = 0.2 (moderate 
overdamping) . 



Here T p and T x are effective temperatures expressible in ip(z) = T'(z)/T(z), 

t. = r + ^l "'- r ,)(^) +cycli e) 

7rm [ (cj 2 - ^i)(^3 - ^1) V 27r / J 



T = T + %r 



{ (cj 2 - u}i)(uj 3 - ui)^ ( 2tt ^) +c y cllc | 



(2.3) 



where 0^1,2,3 are the roots of cj 3 — Tuo 2 + (a + 7r)cj/m — aT/m = and where 
'cyclic' refers to the two other terms generated by the cyclic interchange of 
the Ui (i — 1, 2, 3). In Figure 2.1 we present T x and T p as function of T for 
of underdamping (left figure) and overdamping (right figure). 
For a weakly coupled bath (7 small) one gets from this: T p = T x = 

\%uiq coth(hu>o / 2kT) with Uo = ^Ja/m, the standard result obtained by as- 
suming the Gibbs distribution for the particle. In the absence of a bath (i.e., 
first 7 — > 0, then T — > 0) one would have T p = T x = ^hu . 

When the coupling between subsystem bath (characterized by 7) is non- 
negligible, one has T p > T x > 0, even at T = 0. The state (2.1) is non- 
Gibbsian since T p ^T x , which endangers (near-) equilibrium thermodynamics. 



3 



b Thermodynamic description for adiabatic changes 



The energy of the subsystem can be expressed through the Wigner function 

U = (H s ) = J dpdxH s (p,x)W(p,x) = J dpdxH s W (2.4) 

where 7is(p,x) = p 2 /2m + ax 2 /2. For small changes in the (effective) mass 
m and/or the spring constant a, this allows to define the first law as 

dU = J dpdxHsdW + J dpdxWdHs =dQ+dW (2.5) 

representing the heat and the work added to the subsystem, respectively. 
The latter is equal to the work extracted from the total system (subsys- 
tem+bath) 

Violation of the Clausius inequality. The relation dQ < T dS can now be 
tested at T = 0, where S is not needed. One finds for a change in m 

dQ( T^0) = (^ + ^ + ^ = -^d,^0. (2.6) 
am am m 2 2nm z 

For dm > energy is supplied by the bath to the subsystem, even though 
T = 0. It can be shown that this energy comes fully from the change in 
interaction energy of the cloud of bath modes around the subsystem [H] . 

A setup to test this violation in nanoscale electric circuits has been pro- 
posed; notice that the parameter dependence of T x was already confirmed [Zj . 

Violation of the Landauer bound. For the erasure of one bit of information 
Landauer argued that an amount of heat \d~Q\ > kT In 2 should be dispersed. 
This is a special form of the Clausius inequality in the regime dQ < 0, 
dS = —In 2. However, an explicit example for small T shows that, in a 
process where work is added to the system, one can adsorb heat, dQ > 0, 
and nevertheless become more localized, dS < [S]. 

c Non-adiabatic energy dispersion 

The work can be decomposed in the adiabatic part and the energy dispersion, 
dW = dW a diabatic + dll. For a small, smooth and slow change of the spring 
constant, a(t) = [1 + a(t)]a, one gets at small T to order a 2 jHj 

= T 2 a 2 + aa - adfa (2.7) 
dt v ' 
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Figure 2.2: Schematic plot of the cyclic changes in the spring constant, 
where successive cycles are slower and slower, h characterizes the size of the 
change and t denotes the dimensionless time. The interval — oo < t < t\ 
marks the process that establishes the nonequilibrium state at t — t\. The 
picture shows three full cycles, between the bullets. 



where numerical factors have been left out. For a completed change the adia- 
batic term drops out and the dispersion brings AW = All = ff^ dt&H/dt = 
J^oo dt(T 2 a 2 + a 2 ) > 0, confirming the Thomson formulation of the second 
law (cycles cost work) [§]. 

When T is small and a is a slow function of time, the aa term dominates; 
only in its full integral its positive and negative parts cancel. Thus a negative 
^ is possible. This poses a counterexample to the formulation of the second 
law stating that the rate of energy dispersion be positive jTUj. 

The fact that at low T the aei-term is leading can be exploited. Cycles in 
a(t) can be constructed in which energy is extracted. In figure 2.2 we show 
bell-shaped curves for a(t) = a mSuX h(t), which become slower and slower. 
That construction is needed to let the dci-term overcome the inherent loss 
due to the first and third term 

The total dispersion is positive, because more work is needed to create the 
non-equilibrium state at t\ than can be recovered in the cycles. Nevertheless 
this can be called a "Perpetuum mobile of second kind" 0. The maximal 
number of work extraction cycles is of order 1/T. Optimal extraction occurs, 
however, by making one cycle, due to the trend for dispersion in completed 
cycles. 
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d Entropic considerations 

Entropy is historically a newer concept than heat and work. It has come 
as a surprise that in the present field entropy arguments fail even quicker. 
With the Clausius inequality being broken, there is no sense in defining a 
"thermodynamic" entropy Sthermo = Jo dT'(dQ/dT')/T'; this quantity would 
not have a statistical interpretation, and, actually, the integral would not 
even converge at its lower bound. 

The most common formulation of the second law is: the (coarse grained) 
entropy of a closed system cannot decrease. It becomes for an open subsystem 
(immersed in its bath): the rate of entropy production cannot be negative. 
By defining the flow of Boltzmann entropy, we came to the conclusion that the 
rate of Boltzmann entropy production can be negative already for moderate 
temperatures 0. 

3. Bath generated work extraction in two- 
level systems 

Another application is the spin-boson model, often used in NMR and ESR 
physics, quantum optics and spintronics. Its Hamiltonian reads [U] 

n = n(A) = H s + n B + n I , (3.8) 

'tis = ~Vz + ^y-°x, H B = J2 huJ ka j k a k , Ki = ]r^gk{a\ + a k )a z . 

~ ~ k k 

This is a spin-| interacting with a bath of harmonic oscillators. a x , a y 
and a z = —ia x a y are Pauli matrices, and a\ and a k are the creation and 
annihilation operators of the bath oscillator with the index k, while the g k 
are the coupling constants. For an electron in a magnetic field B, e = g^sB 
is the energy, with g the gyro-magnetic factor and /i# the Bohr magneton. 
We take the transversal field A(£) = except during pulses. This model is 
a prototype of a variety of physical systems [IT] , and known to be exactly 
solvable ^TJ E] , since the ^-component of the spin is conserved, and with it 
the spin energy. Physically it means that we restrict ourselves to times much 
less than T\ (relaxation time of a z ). In ESR physics [T3] the model represents 
an electron-spin interacting with a bath of phonons, for NMR it can represent 
a nuclear spin interacting with a spin bath, since in certain natural limits the 
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latter can be mapped to the oscillator bath. In quantum optics it is suitable 
for describing a two-level atom interacting with a photonic bath [Tlj . 

One typically takes a quasi-Ohmic spectral density [TT] J(u) = J2k Qk^i^k— 
uj)/{TiuJk) — g ft exp(— u/T)/tt, where g is a dimensionless damping constant 
and the exponential cuts off the coupling at uj ^> T, the maximal frequency 
of the bath. Since A = 0, one has conservation of & z (t) = <j z (0) 

Separated initial state. To describe situations, where the spin was sud- 
denly brought into the contact with the bath, e.g. an electron injected 
into semiconductor, atom injected into a cavity, or exciton created by ex- 
ternal radiation, we make the assumption that initially, at t = 0, the spin 
and the bath are in a separated state, the latter being Gibbsian, p(0) = 
Ps(0) <g>exp(— /3Hb)/Z b , where ps(0) is the initial density matrix of the spin. 
In terms of the Larmor frequency u>o = e/h this brings for the evolution of 
the transverse components 

(a x (t)) = [coscut(a x (0)) -smLut(a y (0))]e-^ T \ 

(d y (t)) = [cosut(a y (0)) + smut(a x {0))]e~ t/T2 , (3.9) 

where T 2 = h/(gT) is the transversal decay time. 

The von Neumann entropy equals S = —tips In ps = —px Inpi — p 2 lnp2, 
where p\^ = \ ± o 1(^)1- ^ ne decay of (o~ x ,y(t)) makes the von Neumann 
entropy increase. Since there is no heat flow - the energy is conserved - this 
is in agreement with a formulation of the second law: the entropy of a closed 
system, or of an open system without energy transfer, cannot decrease. 

A sudden pulse. A fast rotation around the x-axis is described by taking 
A / during a short time jT^j, yielding (o"^)' = cr ytZ cos9 ± cr^sin^. 
During the sudden switchings of A(t) the density matrix is just rotated. 

Our main interest is work extraction from the bath. In order to ensure 
that the pulse does not change the energy of the spin, we first consider the 
case e = 0, where the spin has no energy. For small g, 9 = —tt/2 and t ^> 1/T 
the work appears to be 

iy 1 = ^ + ^(a,(0))e-^ (3.10) 

If for a fixed t, temperature is neither too large nor too small, Te~ t ^ 7 ' 2 > 
hY/n, work can be extracted {W\ < 0), provided the spin started in a coher- 
ent state (a x (0)) = — 1. This possibility to extract work from the equilibrated 
bath (t ^> 1/T) contradicts the Thomson's formulation of the second law out 
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of equilibrium. It disappears on the timescale 7^, because then the spin 
looses its coherence, (d~ x ^{t)) — > 0. Classical variations (±7r pulses, which do 
not involve coherence) can extract work only from a non-thermalized bath, 
i.e. for times ~ 1/T. Thus, the effect is essentially quantum mechanical. 

Initial preparation via a rotation. Starting from a Gibbsian of the total 
system, at t — the spin is rotated ("zeroth pulse") over an angle — |-7r 
around the ?/-axis. This maps o x — > a z , b z — ► —a x . Such a state models the 
optical excitation of the spin, as done in NMR and spintronics. The problem 
remains exactly solvable. Taking 6 = — ~7r in the first pulse one now gets 



w x ~ ghT 



e . gT 
- sin u t H — — cos u t 



2tt 

The work decomposes as W\ = AU — AQ, with 



tanh^e-' /T2 (3.11) 



2 



AQ* 9 ~ 
^ 2 



+ T cos coot tanh — e t ^ 72 



7T 2 



(3.12) 



quite similar to — W\ of Eq. f)3. lUj) . An interesting case is where work is 
performed by the total system (W\ < 0) solely due to heat from the bath 
(AQ > 0, AU = 0). This process, possible by choosing t ~ 2nn/uJo with 
integer n, involves a AQ > , AS" = 0, which violates the Clausius inequality. 

The work needed at t — to rotate the spin is Wo = (s/2) tanh[/3e/2] + 
g h T/(2tt). The extracted work is smaller, confirming Thomson's equilibrium 
formulation for cyclic changes (A = before and after the pulses) [§]. 

Two pulses in a rotated initial Gibbsian state. If there are many (very 
weakly interacting) spins, each in a slightly different external field, an inho- 
mogeneous broadening of the u>o = e/h line occurs, for which we assume the 
distribution 

7T (UJ - LOqY + [T 2 *\ 2 

with average ujq and inverse width 7^*, typically much smaller than T 2 . In 
this case the gain for a single pulse is washed out, leaving only the loss 
AQ = —g TiT /2ix, so two pulses are needed. We consider again the rotated 
initial Gibbsian state, and perform a first —\k pulse around the x-axis at time 
t\ and a second |7r pulse at time t 2 (the standard ^ti, ti combination would 
not expose an interesting role of the bath). For the total work W = W\ + W 2 
the averaging over brings 

W = ^--e-^e-^tanh^x (3.14) 
7T 4 2 v ; 
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r- — a i | r sg(Atj ptiuo _ 

Hsm.oAt + [- - _(1 + -j^-)] cos. At } 

For = t 2 — 2ti near 27rn/u)o such that the odd terms cancel, this again 
exhibits work extracted solely from the bath. 

Feasibility. Let us notice that work and heat were measured in NMR 
experiments more than 35 years ago and this technique (glue the sample 
on a copper wire and measure the change in its resistance) can be used to test 
the violation of the Clausius inequality. The ongoing activity for implemen- 
tation of quantum computers provides experimentally realized examples of 
two-level systems, which have sufficiently long T 2 times, and admit external 
variations on times smaller than T 2 : (i) for atoms in optical traps T 2 ~ Is, 
1/r ~ 10 _8 s, and there are efficient methods for creating non-equilibrium 
initial states and manipulating atoms by external laser pulses [16 ; (ii) for 
an electronic spin injected or optically excited in a semiconductor T 2 ~ 1 /is 
[T7| : {Hi) for an exciton created in a quantum dot T 2 ~ lCT 9 s [TH] (in cases 
(ii) and (Hi) 1/T ~ 10~ 13 s and femtosecond (10~ 15 s) laser pulses are avail- 
able); (iv) in NMR physics T 2 ~ 10 -6 — Is and the duration of pulses can 
be comparable with 1/r ~ 1 fis. 



e Bath-induced gain without inversion 

A two-level system with population inversion, i.e. with a negative temper- 
ature, is a working mechanism of lasers and masers. In this context a bath 
is typically considered as a source of undesirable noises and relaxation to- 
wards equilibrium [TJ]. The bath can nevertheless play a totally different 
role, namely in assisting work extraction (gain) by means of a positive tem- 
perature state in the two-level system. In absence of coupling to the bath 
such an effect is strictly prohibited by the second law applied to a positive 
temperature spin state p. 

We consider separated initial conditions with (<3" x (t)) = (cry(t)) = 0, and 
apply a — |7r pulse around the x-axis at time t = + , and a pulse at t. 
For t > 1 /r the work W = AU - AQ is set by: 

AU = -| [1 - e- t/l2 cosu t](cr z ) + ^ e~ t/T2 sinu t 

AQ = + -gTe- t/T * sin u t(a z ) (3.15) 

7T 2 

In the inversion-free case the initial state of the spin is a Gibbsian connected 
with temperature T = 1 / /3 , for which (a z ) = — tanh|/3 £: < 0. For T = oo 
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one has the completely random state, (cf Xj y jZ ) = 0. The work W can be 
negative (gain) provided e > AhT/ir. This situation can be met in quantum 
optical two-level systems P^ ITd] and in NMR This mechanism concerns 
work extraction with help of the bath (it disappears for g — > 0), but not from 
the bath, since now AQ < 0. The origin of the effect is that although the state 
of the spin was completely disordered initially, the first pulse does generate 
some coherence. Due to back-reaction of the bath one has after the pulses 
(& y (t)) = ±gexp(-t/T 2 ) smu t. 

At finite To the term AU can still be negative when To > e/g, which can 
be met for not-too-small g, a condition anyhow needed for having a sizeable 
effect. From a thermodynamic point of view the gain can just be seen as a 
flow of energy from a high temperature (of the spin) to a lower one (of the 
bath), and the outside world (gain). 

There exist other mechanisms for inversionless gain ^3]; the crucial dif- 
ference is that they operate with (at least) three- level systems (atoms), and 
- most importantly — the effect appears due to special, non-thermal states 
of the atom itself. Frequently these states involve a hidden inversion |T2] . 

4. Exact theorems 

There are a few exact theorems that help to reach a final formulation of the 
second law. They all start from initial Gibbsian equilibrium. 

1 The Thomson formulation (cycles cost work) allows an exact proof 
when starting in equilibrium Pj. 

2 The amount of heat that can go from an equilibrium low tempera- 
ture bath to an equilibrium high temperature bath is limited and pro- 
portional to the interaction energy. In particular, this forbids steady 
energy currents from low to high T [20] 

In previously discussed models these theorems can be checked whenever 
they apply, that is to say, when the initial state is Gibbsian. 
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5. What went wrong with standard thermo- 
dynamics ? 

The present research considers small quantum systems not so weakly coupled 
to their baths, that the interaction energy can be neglected. 

For such systems a number of complications show up in the formulation 
of thermodynamics. We have indeed shown counterexamples against various 
formulations, in particular those involving the entropy. Measurements have 
been proposed to test the most obvious one, the breakdown of the Clausius 
inequality, e.g. for pulses in NMR-physics. This immediately implies the 
possibility to violate the Landauer bound for erasure of information. Further 
unexpected aspects are a negative rate of energy dispersion and the possibility 
of work extraction cycles. 

On the other hand, there are exact theorems which save some formulations 
(mostly involving only energy or work) provided the initial state is Gibbsian 
and the work source is not correlated to the test system and its bath. 

The aim of the present field is to establish thermodynamically unexpected 
energy flows on microscopic or mesocopic scales. The field of laser physics is 
a promising play ground for such phenomena. 
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